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(54) DOZING CONDITION DETECTION DEVICE 

(57)Abstract: 

PROBLEM TO BE SOLVED: To detect a dozing condition stably 
by detecting the position of eyes accurately. 
SOLUTION: In the input image of a face shot by a TV camera, 
its first point is extracted from the concentration peak of 
picture element lines in the vertical direction of the face, and a 
group of curved lines which extend in the horizontal direction of 
the face are extracted by joining the first points of the picture 

lement lines adjacent to each other. By using characteristics in 
a general positional relation between eyes and other parts such 
as eyebrows in the face, of this group of curved lines, the 
curved lines representing the eyes are identified to detect the 
position of the eyes. By setting a prescribed area including the 
position of the eyes, extracting the second point indicating the 
position of the eyes from it, which is the same as the first point, 
and detecting the opening of the eyes fore and aft (vertically) 
based on boundary point intervals of concentration peak, a 
vigilance degree is discriminated from a change in its 
opening/closing condition. The extraction of the first and 
s cond points is conducted by assigning a concentration peak A 
where the differential value of the concentration reverses from 
n gative to positive, discriminating whether or not a condition 
that the minimum and maximum differential values B, C of its 
front and rear exceed prescribed values is satisfied. 
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10 f 10/6*0, 7 lmax^o, # £ >^ m/&S 0 Id 

T^^^§^tt, ^^^^8 4— ittfc 
[0 06 1] X 7^2/^8 4TU *j5e*Mfe£fco-0^ 

8 5^ifi^ Cr-Cf^<0»7>ffl[^^^y s 1 m i n# 

20 ^8 7 W««*©t»5MI* s E*tt J: v /h S » 
th&^y-fS 6T\ s 1 m i n rt^fElftffiSrM 

trur. mi 7^fy^8 7— ittfo 

[0062] 7TU ^7^f 1 ma x 

-rt£*>*>°7 7 ? f lmaxjftSl^fto 
-Cl^S^ffd^t^ai-y^-t-S. 77^f lmax^oco 
i^(i^f^7 P 8 1 0— it^K T77^f lmax^lC 

^f^7 p 8 1 0^iit? o 1 0T*(i. 

y, #*^*^WM<fc&frft5^ 
30 a^T-foSJg^lw, *^^ey. 79^. J&^^SrfcfliB 

-/^Xjc J: -5Efi*rBiJKW-St So ^fy7 p 8 1 

<^*/j^«7>ffi (tw^yhB) aM*ajs*u >^y 

s 1 m i nrtidt5«$ttSC tlC*-5 0 
40 [0 0 6 3] J£ Ltv ^r^8 4t\ *U**Mfcfc*« 
»7>ttdSA"e/«CV>^ttaStt-5^. 818^7^8 
1 3— Sltf. ^7^8 1 3TU WlgJHfciftaftft 
0 T-*>5^^ 5 ^SrWaa-TS. WtHI^ o (Dm^fi 

^75//8 1 4— ittfo 
[0064] XT" ^81 4t'(l ^7^>^ f 1 

^6*9(^4fr&tt, ^7^7^8 16^1^ 7t7^>-^f 
1 0OtHSfit^6tC*o^^fi, ^fs/7 P 8 15T% 
77^f lmax^^^f 1 O^MfcLT, 
so >>^8 1 6^itfr 0 ^7j/^8 1 6 -01*. # f 1 
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[oo6 5] o<D»&m*mm\^T&t>tiz>»&&. ± 

* f 1 0<DVrmm*6lZt£Z>b* ^f^y8 15T^ 
yh(Oaffl*ttf*>577^f 1 ma x. X^ls* f 1 
0 IT, ^^^f 1 m a x x # * >^ f 1 0 £ 

V^^ s S<jf^V>-CV>-5C^T*fc5o i lma 10 

x, f l O^W^^^T, B^^^SfBi)- 

lujoftSI<4oT<5I-e8i*t577^f lmax 

[0 0 6 6] ^LT. *t*/7S 1 3T\ »^0t 
ftl^fclftfflSti/Si:, 01 9^fj/^9 1— iStf c * 
fy^9im ft»5WKM«fEB8-ey^y s lmin 

*r 3 a***-** aiJE-rsifr&ji^^y^s 2- 20 

[0 0 6 7] ^^>^^9 llraiA/^fcd^. ¥0£*Hfc 
*fi, fc/hf&SHttf^^y s 1 m i ndS3E«rS*bT*5 

^Ylg^^^ey o k s 1 dirfEtgi-^)^ 37 30 

1 m a x £r 1 l^lt, ^ry^93, y 

[0068] ^<o«, iE<n%tL5mfrKtiZtiiri^ 77 

?f 1 ma xj&S 1 ^K^StlT^Sfctf), ^^5/^9 3 
— Z.ZX-Wfett&bteZfcftm***}) s lma 

4^^^XIE^cfil:^M^fUT^^^^ P 9 5— ittfo ^ 

h lmax iriiWMS^-C 1 0 0 0 dSH3e**UT*5 «9 , 

1 0 0 O^loa^IfSixSClrlcie, ZtllZ 40 

5 0 ^7^7 P 9 3t«^^^a^^^y s 1 
ma x^lEttlSJ; 9 /J>£l 

tft, ^^>^^9 5TU ^!)slmin^!)^f 

1 0 tttJBMt*-*. 

[0 0 6 9] ^7S/7 P 9 6m Yffi«arfi»rWfi»* 
*&<fc»3H6^ii«>T. ^7^^8 3(111 YBm& 
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M<aft*«4MS (tW^yhc) aqfcttia;lv**y 

s 1 ma x\Z i gete£th2>Z.b\z.fj:Z> 0 
[0 0 7 0] * It, *<0«5Nfc& s mJ*»;b*U 016 
0>^^S 4 T*1&fcU$*u6 ^777 P 8 5(7)W 

T?«:. Vytfl lmax^ll:K^T^5»$: 
^J^-T6o f 1 ma x^l-C*lt*ttftttt|jK>f V 

hft L£ LT^T^^8 1 0^*13^ f lmax 

^Itfc^f7/8 8T\ s ImaxWEi 

li, o k s 1 d^lEtttUTfcSiSllttJK-r^h^ 

»W*friJ:K|fcU 7>fy#f^:YMiI^f,/^3 
TnOy^-^^/K-r yh^^ey KHEttrTSo ^^>^m^r 

^f^y^yh lt^C7^ >±<Dihm^-f v h 

£-frT. 1 0— iitf 0 ^U^7y^8 8(7) 

2NJS»dM^ey s lma x(OE»ffi^3f^ffiJeJL±-C*^» 

ttm^K-r v h&L£ ur^77/8 1 0— atfo 
[0071] jxt^^s 1 o-ett. y ^ey o k s 1 d. 

^^y s lmax. XV^f f 10, ^^^f lmax 
S^OJBHfcLT. ^^>>^8 1 l^Jt*, C^TYJ^g^ 
ffi^*J^*r***^«^ffi^ji^T. ^7^^8 3-1 
19. ±IE<0«a3&SWt/fT*t>*t* 0 Mil^7i/7 P 8 3 

[0072] *SfeK«f±K±o J: 3 M^) 

I^I^fft (*/JnJS4MS) ^^h»S^ 
*A'£{b *-t*t^A«5HIJE*rKIW 

[0 0 7 3] ^tw^2cD^^J(ro^Tt^P^-^5o CO 
[0 0 7 4] ftA»^rffi(7)A# S 
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[0 0 7 5] ^ot, Mi^t^-^^tVhB^f 

[0 0 7 6] ftic. *3 0*Jt«^o^T»5Bi-*o w 
S *:W3ei-*Bfe«[*r»/J4»d««>*# * X»k 

*>*»^fc:. rw*5Ht*ii£*«-Aj«t£il»oE«^||[JE 
[0 0 7 7] mi © jUtW-Ctt, :£»$HtX*rKIHJfc*3 

^®S^>ft:t: 0 -^^2o^^5pj^^$ > ^ o 

V hAWffitijf-^ £ LTIH2 2—0 2 5<D7t2—^^> 

[oo78] m<D&w&mm& 2 3 m 1 <nnmm 

traflH^^^ey slmin, ^^eyslmax. 
oks Id. 10. tffr^m. 7 7 1? f 1 

max f>tb6o * * y s 1 m a x fcm&%&X. 

[0 0 7 9] 12 2(7)^77^12 1-777^12 8 

am 1 60^1 <DmMM\z&ttz>*'ry^8 1 —777 

7&><bft/Jv|fi (fcT-^JK-f ^ hB) ^^yslminl: 
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[0 0 8 0] It, 7fy/l 2 4X\ WSfctffci:* 

12 1 0— itt> 0 77^/1 2 1 0-777^1 2 13 
fct. 01 SeofBl^mfeMt-fctt-S^^jy^S 1 3-7 

f Ima x^RSi^rt^/UU, »«mS:B&ih-r 

[0081] 777^1210^ o-e*t^*j^stt 

fcifr&fi. 02 5(O^fy^l3 1^Stf, X7^1 
3 1 ditAyfc^ t f±, W^a^»*«^jEtfc 9 . r 

y s lmi ndsS«rStfC*5?), *<Z)fE«ffi;&sj^ttEA 

20 -f V h A*s*/J^«»«W*ftW«r«!J£rs jK>T >bkte 

[0 0 8 2] 77^1 3 1 -m. ^yslminll 

f 1 ma x^U^VN^^S^f+i-fllJSJ&^^^SripJ^ 
t6o 1^^1^7^13 21:1X77^1 

3 z^m^. m^^m^n^yzfi 3 

[0 0 8 3] 77J//1 3 2m ©ft^^jEJCRtei" 
5»5Mt W^hA) <£>Yffi«€:**ry oks ldll 
fE«i-So (D77^ f lmax^lilSSt^ ®^ 
30 y s 1 m i ntCfE«UT^S*/j>«»ffl{-«**^Jt-C 
1 ma xidiEtg$^ir5c - 5 ttf/J«5>ffi: 
tfcW-rSBf^tt^lRfeSttS,, 77^1 3 3X\ 

lmax^l^3^fx^U 1 (DigrSteX 
77^1 3 4^i^, 1X^1/^(1X7 7^1 3 7^ 

[0 0 8 4] 7777*1 3 4m 2pJ^*£fc*»# 
teM^y s 1 ma x<7)lE^ffiXfo£J5Ff^|I (SflSffi) 

7^13 7— mi?* 777^1 3 lm 
40 in, ^^^f 1 OSrlOJiJHtLT." 777^1 38 — 
litfo 777^13 8X11 Yll^f^HW^^^ 

[0 0 8 5] ^tt, 777^134X\ ^^ey s lm 

^ bA<Dtbtti$kmmit£iv* 777/135 

f-^o^T. H^t£c7)7~^ i:lX7^ ^gf^b^^V o 
k s 1 dtCfEttU-CfcSYj^S^^-r ^h^^y t-IEtS 

i"6 0 ^ y^m^ y > y h tt^ D7^f 

tttii^-r V h«r»HlkS*fca)%. 777^13 6^1 

50 tPo 
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[0086] ^"ry^fl 3 6X&. o k s Id. 

y^ey s 1 ma x, j3$l/# f 10, 77^f lmax 

[0 0 8 7] #HiS0!lfi x J^-L<£>£ 5l-«/*£*u 

fi5N^»as£7gLfc#^T-fc. BB^*#jftfc»JSBS« 10 
fcW«<ottjft3&s»?>tt*i:i:t(c. RB<z>MA&ttid*Ktt 
[0 0 8 8] ^{:S4^Wro^-C^t5 0 

>- h AKftKBtete (SUNK) <£ 9 I 

3*b*:»a\ i/J>»^ ^ y h b till: 

mrz>#<<^vc<Dm^ «^f^Mi^^^f, 20 

[0 08 9] WEHttfll-ettu Bf3e«*jBx.-5 lEffltfMiC 

J: ^h*r«U-t"**^5^S:*3er*c i27- 

^ 3 <nmMM\^lsfrMj&<DM\^?t y m i n i 
i aM»;t£;ft,3p ^Dmini i fcfc*/W85Mt<0YJ* 

[0 0 9 0] 0 2 7 <DX"rv^l 5 1~^7^-/^1 5 8 

i n(::lElit£;h,<5<>: £ $/ rf 1 5 6 fcUsi^T* 40 

/J«M^YHl^^!)m i n i i ^IE«t$ii:-5 0 * 
7f«o»/JHK*«ttJi--5BRlc:. f 

1 0 Sr*flHtt«»;:«t>. WlsMfctti^^-^tftffljfe* 
o y -< j: £ fstg^r gijifei- 5 fc <&*Qs3l-e*> 5 . 

[0 0 9 1 ] JX^s/^l 5 4T% *\i&tfkht& 

15 1 0— ittfo 5 1 0—^t 1 ^1 5 14 

tt. Hll 8Wfl OHJt«^*5lt S^fy^8 1 3—* 

x>>^8 1 7 tmmx% o<Dm&m<Dfcmi>s6®m^it 
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f 1 ma x0^^tyt;H.t, KtfcafcS&Jhi- 

•So 

[0 0 9 2] ^f^l5 10T\ OX'fa^kWMZtl 
fc^n. 02 9(7)^^^^1 6 1— Stfo ^(D'i&tem 

^ry^l 6 5 nOTMI^^^^Um i 
n i i l-Bf»LTfca»/J>«5HK^YaHP*:3lt^r*«) 
fBoSBKF *JStt (»r5£ffi) 

5^^2 0tK-T >- h £ UT«SUiU7-f>'##<?:3K-r ^ 

fi. tr-^jK-fvhB^^^YffiW^ift^iatFdSiE 
W«BlKrtl-#^^hC*sUiauftv^»*l^ ^y 
hA^«^i-**l*>StMiJB2«>jK-r^ h0>ttHtt>& 

flt^^tL-CtT^P k. ^Tyyi5 3t*^7>fyt'(7) 

[0 0 9 3] *jt*«tt, £X±.(D£ i \zmtft£tl. ft* 

[0 0 9 4] fcfc:, JB5©IEKWcoi^lftWi--5 0 C 

sj-^^KA^fflm^WfcSixsm^ 

k&V5±-tZ>Zk&B&0k-rz> o -i-t£friom3 0<n£? 

^arsiai ufci^-f y hAi ^r^db-r ^> k # icjjf 

EBI«)W*|t«:jtt^.sK-f y hA 1 S:ttHn?S*< 
[0 0 9 5] ^r-C% #^atflfH:*/J^|tB ^ 

ix^Wiw. »/h»4MtB&±jr/hS^BS2<o»/J4RiHI[ 
^^-feyuL, zK-f ^ httttl«:*/J4»5HlB l*fco#-f 

[0 0 9 6] CCT% ^ 4 COH^J^^ Lfc^(Df&|^ 
>^ey S lmin2^ ; e!Jmini i 2 V ^7^f 1 
m i ndS«X.P>ix6, ^yslmin 2 fctft/hffltfMi: 
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n i i 2ll»/h«^!BWKIHrt^*a«^YK«*E 
5 0 ^7^f lmi nfi^^-y s lmi 
n 2<D|El»|tH««l»79^-eR*S*tfci:* 1 fcft 

[0 0 9 7] H3 SWt^Vhttao^a — ^ 

S/JvfgBaM^-JJ s 1 m i n\Z.mm£tiZ>t t fcfcl, * 
^>>^1 8 6^^V>-C»/MS^MtBWYffiaiSry i &y m 
i n i i i^lElg^^r^o 

[0 0 9 8] is3£ 
i^MT^^U s 1 m i nOlEfl6ffl-CfcS*/MS4MI[B 
£<9 Se>fc/>S^J[52<0tt$HtB lj&Hftm**L*:i:#. 
»ffl*:#-f ^ h A yhAl t-«J9«lx.-CfT*5 

*fiE<0*JS»*fcftor^S»4Mi[36S^*y s 1 m i n 

[0099] ctaBL #j^#w»SHtasy*y s i m 

i n 2<DW&^£*)±%^m&&. ^f>y^l8 9^i 

s lmi n^E*ttJ:f9/h*t^» 
<S\ JB2^*/J%»4H1B Xt^/188 
-e»/jmt4Mt3E*r^7^f lmi nfcKeu *JS*f« 

ma xlEtg-^5o ^Ds lmin2, ^limini 
i 2 fclttJR 2 ^*/h»4MS B 1 <D*# $ £ YftKfc-tJt 

BUSIES £1*: 6 o 
[0100] ^fy^l 8 1 2-^T5'7'l 8 1 6 fi, 

S§4<^H^j<D*^;y:/l 5 1 O—^^^^l 514^ 

T< 5fft?KeS^a79^f 1 ma xORSSr^y 
ir/PLT. IWfttaSrBSJhi-S. ttt, ^f>^18 1 
2T\ 034^73/^ 

19 1 ^mUo 

[0101] ^77^19 1 "Cfl. ^yslminil 
ISlt^^fcS/J^^ffiB^fEtgffi^^'tt^T, 7>)>o:7 
7^ f 1 ma xJ&Sl -e*l^l^5*{*tr»SJ£^^5^* 

[0 10 2] ^^s^l 9 2T*ft h A<£>YJ3£ 

i^r^^y o k s 1 d{r|Ett^5o (D77^f 1 ma x 
£ 1 J-KS-rSc ®^^y s 1 m i niCfEtSUTl/^S 
/J«»tt«-««fC«r^tT*l|LLfct<OSr>*y s lma 
x{rf£lt^^5o ®^^ey s lmi nP^COl^tiffi^y ^ 
y s 1 m i n 2 ld|Et§i~6o ®m ini i2H^Um 
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1 n i i oEt8ttS:IE«S*-5c - 5 LT*/J^»3HO! 

[0 10 3] ^7i//19 3(t ft/J^»4>fflffl3E«r^7 
lminOfiS^JSU 77^Sf§ntl/^i 

SS^^y o k s 1 d icFM^ey IT, 7*7# f lmi 
10 n 2r#BSJHb-r£ 0 ^7-7/19 5^7^7 p 19 11|j: 

02 9 0^4 0H^Mi-^ti-5^v L ^^ P l 6 1 — x-^^z 

fcmztizt* ^73/^197^^^^^^^ 

m i n i i 2^|E«L-Cfe€>&/h»^1il[B 1 ^YffifllS: 

*JWr-e3fSBS!t«rt^»&. ^7^19 8 Xtf«< V h 
A 1 £rfgl $>S^^2C0tK^^ h £ U«t±H7-f V 
20 #-*§• t tK^ > h (D Y«K&#-f >h** ] J IwlEtS £ -fr 

^r^7 p l 8 3T^7>fyT*^JSI:«9f 

[0 1 0 4] **lfi«ttH±WJ:5^«**tt. ^4(D 

»#ffitf)A «P J: «9 KHt*J»r-e#>f >- h asatHT* *< 
30 fcS£i:4rBfrjhT?#<5o 
[0 10 5] 

JttiaiU W^«lii»Woi«Ufc«l«>ttttljft*r 
o-cmttKc»2^aa*«:aUi-*i:l:tl-. ^2(D 

otta^*aau «^«itfcS3^iffls^7 
[oio6] m&m 2 e«^»w-ef±, ^-r > h (d« 
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^£%&&m7£&ftteo<Dx\ mmtstiztf-o hum 

[0 10 8] «HB»/h«5MI[i:mEE»«HB[<o* 
[0 10 9] £b^, flfrfE»l ^ h»iH*»*>£ 

[0110] ft*>\ ffiria»5>ffidSA^^E^K(E-r-5Pi 30 

[0 3] g|R9ttli«UJ^Sftf^*^-r7n— 
[04] IB^tt«»U©^ftf^*r^7n— h 

[0 6] skdtk-t >- h^aajasgottwrs'H-e*) so 
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[0 7] ftj|»W^«m«:8ftWi-SH-e*>-5o 

[0 8] »io«a^^-^k«asr»wi-sHT 

[0 9] ftJl»»^bBB^ffi«**Hirs*«S:!ftWi-5 
0X£>6 O 

[010] K©B«lftfflO*!M»fP4rj3ci-7n--^^ — 
[011] JB2^^^hoaffiJDBffi*:ttM"*-*H-C*) 

So 

[012] K©*iW^I»/S36Sfc*fc#^BI)«*ffl*r»W 
-T60T^5c 
[013] IR^ii«MftffiS:ttMi--5 0-e*>So 
[014] tIfi^WS««S:BlWt5HT^5o 
[015] #-f ^K«)»lM!tl4:BlWi-6HT*>*. 
[016] KttttiO^iSSif^^^i-^ci-^^- 

[017] ^>r^htta<o«aibfp«r33%i-7P-^^"- 
[018] sK>r ^ ham^stbf^sr^-r^n-^-^- 

[019] tff-f V htttao^ttf^tr^^n-^-Y- 
[02 0] *S8W©JB2<©|llt«*c*3»*sK-r^ h<D& 
[02 1] *ISM(7>SB3 0||Jfi^*jft'5 2K^>' h<o« 

[022] *^^haffl©«a«if^s:^-r7o-^^- 
h -<?*>*. 

[02 3] ^ > hiffloM»^*^t7 o-ft- 
[02 4] ^>rvh«ffi<0«««|fP*^7ci-^- + - 

[025] #^^hau©«s3a«iffs:*-r7ci-^^- 
[026] ^w<ojR4^iBft«^*5it-6 3K>r^h^>a 

[02 7] W y h«ttl(D«! ! S»M^t7P-^t- 
[02 8] aK>T ^ httttJ^Sfb^^i-^D— 
[02 9] ^ is httW^SSj^^^n— 
[03 0] *«W^»5<7>||16«^*3itS^ > h^ft 

[031] ^v-.hfflaco^LSft^^-r^n-^^-- 

[03 2] ^VhattJO^ibf^^^-r^P-^-y- 

[033] *>r^httu^«a«if^*:7i%i-7o--^- 
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hX*fe5o 5 

[H34] ^>T^haffi^fti3S»f^*^i-7t3-^— 6 

K'fc^o 7 

[B3 5] ^.^httW^^SSif^^-r^n-^- 8 

hTfcSo 9 

[El 3 6] 2 1 

[0 3 7] teO«3(5«*:^i-H"C*>4. 2 2 

[H3 8] «0*^«^**A/*Tlil*<Z)»*»l:t*^ 2 3 

IRiMtaEYkSr^i-H^fc-So 2 4 
[«F#0>tt«] 10 2 5 

1 mmxtj^® 2 6 

2 M^ttlfi 2 7 

3 ii^yhitBf^ 2 8 

4 
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